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ABSTRACT 

The main purposes of this pilot study were to obtain 
school principals* evaluations of recent Central Michigan University 
graduates and to determine how the graduates felt about their 
preparation and the professors who had taught them, seventy-nine 
principals evaluated 252 teachers in urban, suburban, and rural 
schools in lower Michigan. The sample was representative of employing 
communities and proportionate to the total number of elementary, 
secondary and special education teachers graduated by CMU during the 
calendar year 1968, 1969, 1970, Eleven criteria were used in the 
evaluation. A factor analysis yielded three factors in the 
evaluation: the skill factor, the human factor, and the academic^ 
factor. The evaluation form had both content and construct validity. 
Three of the eight conclusions of the study indicated that teachers 
prepared at CMU are better than average in their third year teaching, 
teachers prepared by CMU were satisfied with their education, and the 
way teachers feel about their instructors affects their satisfaction 
with their education. Further studies should be done using matched 
pairs of teachers surveyed and principals* evaluations of teachers 
based on behavior criteria. Appendixes include evaluations, factor 
and chi-square analysis, (MJM) 
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ABSTRACT 

OF 

A PILOT STUDY TO EVALUATE TEACHERS 
EDUCATED AT CENTRAL MICHIGAN UNIVERSITY 

by 

Dr. C. Jarvis Wotring 
January 29, 1972 



INTRODUCTION 

Hie main purpose of the pilot study was to ask principals who had recent 
Central Michigan University graduates on their staff to evaluate them in their role 
as teachers. The same teachers were asked how they felt about their preparation 
and professors who taught them. Of further interest were the hypotheses that 
teachers and principals would tend to agree on their evaluations, that important 
factors of teacher evaluations could be identified, and the grade point averages 
and American College Test scores predict success in teaching. 

Two hundred fifty-two teachers were evaluated by seventy-nine principals 
in urban, suburban, and rural schools in lower Michigan except for the southeast 
comer which is served by other colleges and universities* 

The sample was representative by communities and by the proportions of 
elementary, secondary, and special education teachers graduated by Central Michi- 
gan University during the calendar years of 1968, 1969, and 1970. Of the ninety- 
four and six- tenths percent returns, eighty- nine percent were used. The five and 
six-tenths percent were too late to be used in the study. 

The instrument provided for evaluation on eleven criteria: 

1. Planning and Organization 

2. Methods and Materials 

3. Motivation 

4. Evaluation 

5. Management 

6. Overall Classroom Effectiveness 

7. Professionalism 

8. Community Skills 

9. Academic Preparation 

10 , Personal Qualities 

11 . Human Relations 
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Content validity of the evaluation form was determined by a group of about 
fifteen teachers in the Thumb Area of Michigan* by eighteen teachers in the Mt. 

Pleasant, Michigan area, and approved by the Central Michigan University Depart- 
ments of Elementary and Secondary Education. A factor analysis of the form showed 
three factors in the evaluation: the skill factor, the human factor, and the academic 
factor. The evaluation form had both content and construct validity. 

Use of the form by principals appeared to be reliable as far as could be de- 
termined by applying the "t” test to compare the mean of the self-evaluations of 
one hundred forty- four of the two hundred fifty- two teachers studied with the mean 
of the two hundred fifty-two teachers evaluated. The means were significantly 
alike at the .005 level of confidence. 

Principals were asked to evaluate teachers on the eleven items by means of 
the rating scale below. 

Unacceptable teaching behavior 
Needs much improvement 
Needs some improvement 
Degrees of acceptable teaching behavior 
Better than acceptable teaching behavior / 

Outstanding teacher behavior 

Raters were forced to make a choice between four and five based on the assumption ' 

that a better distinction could be made to determine the areas of strength or weak- 
ness. V 



1 . 

2 . 

3. 

4. and 5. 
6 . 

7. 



RESULTS AND CONCLUSIONS 

Teachers prepared at Central Michigan University are better than average in 
their third year of teaching. Seventy-six and four-tenths percent received ratings 
of five, six, and seven. The mean was 5.2665 with a standard deviation of i. 14. 
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Table 1. ITEM RANKINGS BY MEANS WITH STANDARD DEVIATIONS 






Mean 


S.D. 


Personal Qualities 


5.575 


1.21 


Human Relations 


5.456 


1.24 


Professionalism 


5.444 


1.26 


Academic Preparation 


5.345 


1.02 


Communication Skills 


5.293 


1.09 


(Items below deal with classroom effectiveness) 
Motivation 


5.253 


1.11 


Methods and Materials 


5.222 


1.09 


Overall Classroom Effectiveness 


5.182 


1.04 


Management 


5.095 


1.32 


Planning and Organization 


5.079 


1.13 


Evaluation 


4.988 


1.08 


Average of the Means 


5.2665 S.D. 


1.14 



Items in the above chart, the reader will note, can be divided between those 
related directly to classroom effectiveness and other achievements of teachers. 

Hie item Management, with the greatest variance of any item, correlated .78 with 
Overall Classroom Effectiveness. This was true at the • 005 level of confidence. 

The three things that, in the minds of evaluators, lowered the effectiveness of 
teachers were Management, Planning and Organization, and Evaluation. 

Teachers were not judged too differently in urban, suburban, and rural schools. 
Judging by the "t" test, there might have been a difference between rural and suburban 
secondary teachers, as well as a difference between rural and urban teachers in 
special education. However, the sample was too small to draw this conclusion. 

Teachers prepared by Central Michigan University were satisfied with their 
education. Correlations between teachers' self-evaluations and the items below 
were significant as shown: 



SEV and Professional Education • 01 

SEV and Rating of Instructor None 

SEV and Satisfaction with Present 

Position • 01 

SEV and Present Life Style None 

SEV and Preparation in Fields other 

than Teacher Education • 01 
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The correlation between Ratings of Instructors and their Professional Education was 
also significant at the .01 level. 



S, ? = 

Table 2. RATINGS OF INSTRUCTORS AND SATISFACTION WITH 

PROFESSIONAL EDUCATION 



Level of significance 



Groups 


N 


r 


d.f. 


.05 .01 


Elementary 


35 


.675 


33 


.430 


Secondary 


64 


.335 


62 


.320 


Special Education 


42 


.464 


40 


.393 


Total N 


141 


.467 


139 


.219 



Dr. GaskilTs follow-up study (August* 1971) showed that eighty-two percent 
of the elementary teachers, eighty- six percent of the secondary teachers, and 
eighty-eight percent of the special education teachers felt their professional edu- 
cation to be adequate or very good. 



Grade point averages correlated low but significantly at the • 05 level with 



the following: 



Overall Classroom Effectiveness 
Professionalism 
Communication Skills 
Academic Preparation 



Pearson r 
.1764 
. 1655 
.2105 
.1360 



ACT scores correlated . 1524 significant at . 05 with principals* observations of 
Academic Achievement. Seven correlations were negative, four were positive, and 
only the one mentioned was significant. 

GPA*s and ACTs did not predict teaching success according to principals* judgments 
of teaching success in this study. GPA's did the better job than ACT*s, and then only 
on four items. The fact that there was little relationship was shown by a Chi-square 
analysis. 



There are eight important conclusions: 

1. Teachers prepared by Central Michigan University are 
average or better than average • 

2. GPA*s and ACT’s do not predict success in teaching. 
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3. The School of Education should probably give some atten- 
tion to the weak areas of Planning and Organization, Manage- 
ment, and the use of Evaluation techniques in teaching. 

4. Regardless of the subdivisions, there are three factors 
that should be included in forms to evaluate teachers: 

a. The skill factors 

b. The human factors 

Cm The academic factors 

5. Principals do a good job of evaluating teachers as was shown 
by consistency of their use of this instrument to rate teachers. 

6. That teachers and principals tend to agree was determined 
by teachers* self-evaluations and principals* evaluations of 
those teachers. 

7. Teachers who graduated from Central Michigan University 
are satisfied with their education. 

8. The way teachers feel about their instructors affects their 
satisfaction with their education. 
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A PILOT STUDY TO EVALUATE TEACHERS 
EDUCATED AT CENTRAL MICHIGAN UNIVERSITY 
Elementary and Secondary Graduated in 1969 
Special Education Graduated in 1968 and 1970 



SIGNIFICANCE AND PURPOSE 

At this time. Central Michigan University’s School of Education seeks more 
feedback on the performance of the teachers it has graduated. On page thirteen of 
the final draft of the Five Year Plan, Section Four, C, points out the need for a 
follow-up of the employers of recent graduates ”to get their evaluation of the pro- 
ducts of programs that have been conducted.” This, with other information, would 
enable the School of Education to strengthen and revise programs as needed and 
provide for further research. 

The Bureau of School Services already had some information from a survey 
on the group studied. It was felt that there might be some interesting comparisons 
between the attitudes of teachers and their self-evaluations. 



STATEMENT OF THE PROBLEM r 

i 

Basically, the purpose of the pilot study was to determine whether or not the 
School of Education is meeting its goals by seeking answers to the following questions: 

1. How well do the teachers which Central Michigan University has pre- V 

pared perform as evaluated by their employers? Are they prepared ** 

to be able to: 

a. Plan and carry out learning activities for students? 

b. Establish and maintain a classroom climate conducive to 
learning? 

c. Establish and maintain rapport with students and the others 
in the school? 

d. Be professional in their duties and active in professional 
activities? 

2. Is there a relationship between grade point average and success in 
teaching? 

3. Is there a relationship between the American College Test scores and 
success in teaching? 
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4. Are there any indications of relationship between students* attitudes 
toward their education and their success in teaching? 

5. How can these findings be used to improve the work being done in the 
School of Education? 



DEFINITIONS 



Rural school systems were those described as being primarily in rural 
agricultural towns under five thousand in population. 

Suburban school systems were those in cities within ten miles of industrial- 
business centers and urban communities; citizens were primarily commuters to 
larger cities. 

Urban school systems were those in cities which were business- and indus- 
trial-centered. These cities had a population of ten thousand or more. 

An elementary teacher is certified to teach grades K to eight. 

A secondary teacher is certified to teach grades seven to twelve. 

A special education teacher is certified for teaching special education 
students at the elementary or secondary levels. The preponderance of special 
education teachers participating in this study are certified as elementary. 

Behavioral criteria are descriptions of teacher acts which can be quantified 
by experienced supervisors, in this case, principals. 



ASSUMPTION 



It was assumed that: 

1. The criteria for a'good teacher can be identified. 

2. Such criteria are observable and can be scaled. 

3. Experienced practitioners (school principals) can make 
valid judgments in evaluating teaching acts against the 
behavioral criteria. 

4. Teacher self-evaluations have validity. 

5. There is a relationship between teacher behavior and 
student learning. 



INSTRUMENTATION 

The evaluation form contained eleven items as follows:* 



1. See Appendix A for the evaluation form. 



Planning and Organization 
Methods and Materials 
Motivation 
Evaluation 
Management 

Overall Classroom Effectiveness 
Professionalism 
Communication Skills 
Academic Preparation 
Personal Qualities 
Human Relations 

These items were selected because they most commonly appear in evalu- 
ation forms. The behavioral objectives used as the criteria were descriptions of 
optimum teacher behavior expected. Further, the items were determined by 
twenty supervising teachers from the Thumb Area and verified by eighteen super- 
vising teachers in the Mt. Pleasant Area. The behavioral objectives were accepted 
by the Departments of Elementary and Secondary Education. 

The scale to evaluate achievement of the objectives ranged from one to 
seven. Number one was used as an indicator of unacceptable teaching behavior. 
Number seven was used to indicate full achievement of the described behavior. 
Purposely, raters were forced to choose between numbers four and five to indicate 
whether the teacher tended to be better or poorer than average. It was assumed 
that the intervals between the numbers were equal. 



VALIDITY 

Because the instrument was subjected to the scrutiny of two separate groups 
of supervising teachers and the criteria were found acceptable behavioral objec- 
tives by the Departments of Elementary and Secondary Education, it has content 
validity. 

A factor analysis 2 of the eleven items of the evaluation instrument showed 
the top six items on the chart above to be the first factor. In this case,^ they were 
clearly all related to classroom effectiveness. 

Personal qualities. Human Relations, and Professionalism, weighted in that 
order, came out a second factor. 

Two items. Communication Skills and Academic Preparation, were a third 

factor. 

Significance of the factors can be seen if they are labeled: 



2. See Appendix B. 



